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We show how the steady-stale distribution and the mean squared error 
of a delta modulator with an ideal integrator can be computed exactly 
ivhen the input signal to the modulator is a stationary Gaussian process 
with a rational power spectral density. Curves are presented for the mean 
squared error as a function of (he quantizer step size and the sampling 
interval for several different input spectra. The mathematical development 
makes use of the Markov properties of the system and involves series ex- 
expansions in n-dimensional Hermite functions. The key integral equation 
is generalized to treat the case of a realizable filter in the feedback path, but 
an analytic method of solving this equation has not been found. 

I. INTRODUCTION 

Demand for the transmission of digital data grows apace as the 
computerization of our society continues. This demand, coupled with 
the many recent striking advances in solid state circuit technology and 
with new concepts of digital switching, assures an increased role for 
digital transmission systems in the near future. The existence of such 
systems in turn gives new importance to digital means of transmitting 
analog signals. This paper is concerned with one such means — delta 
modulation. 
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In its simplest form, as depicted in Fig. 1, the delta modulation 
transmitter approximates a continuous input signal X(t) by a staircase 
signal Z(t) that has treads of duration T and risers of height A. Every 
T seconds the staircase either rises one step or falls one step in order 
to approach X(t) at that instant more closely. At each rise or fall, 
the delta modulator emits a binary digit that specifies the direction 
of the step just taken. At the receiver, these transmitted binary digits 
are then used to reconstruct Z(t), or perhaps a smoothed version of it. 

This system was first described in the literature in 1952. ' Because of its 
extreme conceptual simplicity, and its relative ease of instrumentation, 
delta modulation has attracted the attention of theorists and experi- 
mentalists alike, and many studies of it and its generalizations have been 
undertaken in the ensuring years. Many of these have been concerned 
with calculation or measurement of the mean squared error suffered by 
signals transmitted by delta modulation and with determination of 
how this quantity varies with the parameters of the system. Almost 
without exception, the theoretical studies are based on approximations, 
the range of validity of which is difficult to determine. 

The present paper is also concerned with the mean squared error 
inherent in delta modulation. Our attention is focused on stationary 
Gaussian input ensembles X(t) that have rational power density spectra. 
For this class of inputs we show that the mean squared error can indeed 
be computed exactly for the simple modulator of Fig. 1. 

Since the mathematical analysis entailed tends to become quite 
involved, we have organized the paper into three main parts. Section II 
presents definitions, discussion and the results of numerical work. It is 
free of laborious mathematical derivations and is intended for the 
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Fig. 1 — The waveforms of a simple delta modulator with ideal integrator. 
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casual reader. In Section III a detailed mathematical treatment leading 
to a means for computing the mean squared error is given along with 
some necessary additional theory. Section IV describes a generalization 
of the present study to systems with realizable filters in the feedback 
loop. 

II. DEFINITIONS, DISCUSSION AND RESULTS 

2.1 Some Definitions and Descriptions 

The modulator described in the Introduction can be defined with 
mathematical precision as follows. A signal X(t) is given for / ^ 0. 
Also given are a sampling period T > 0, a step size A > 0, and an 
initial value h. Numbers Z, , j = 0, 1, 2, • • • are defined recursively by 

Z = h, 

fZ,_, + A, X T)>Z,_ 1 ,. = 1)2j3 ,.... (1) 



IZ,-i - A, X(jT) ^ Z,- t , 

The delta modulation approximation signal is then given by 

Z(t) = Z, , jT&t< (j + l)r, j = 0, 1, 2, ... . (2) 

Notice that Z(t) can only take on values from the set S = { • • • h — 2A, 
h — A, h, h + A, h + 2A, • • • j. Indeed, the allowed values of Z{t) are 
restricted in a periodic way. If I lies in an even interval, i.e., if 2nT ^ 
t < (2n + l)T for some n = 0, 1, 2, • ■ • , then Z(t) must take a value 
from the set 

S. = { • • • h - 4A, h - 2A, /*, h + 2A, h + 4A, • • ■ j. (3) 

If t lies in an odd interval, i.e. if (2n + \)T ^ t < (2// + 2)7' for some 
n — 0, 1, 2, ■ ■ • , then Z{t) must take a value from the set 

S„ = {■■■ h - 3A, h - A, h + A, h + 3A, • • • ) . (4) 

Due to the non-linear nature of (1), it is very difficult to say much 
about how well Z(t) approximates any given signal X(t), nor is this 
question of any real importance in a communication setting. What 
matters is how well Z{t) does on the average in approximating the 
members of an ensemble of functions that represents an analog informa- 
tion source. Thus we are led to consider the delta modulator described 
by (1) and (2) when X(t) is a sample function of a stochastic process. 
Throughout the paper we shall restrict our attention to the case in 
which X(t) is stationary and satisfies the conditions 
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EX(t) = 0, EX\t) = 1. (5) 

The latter constraint sets the scale by Avhich signal power is measured. 

With X(t) stochastic, Z(t) becomes a dependent stochastic process, 
and we can speak of the joint distribution of X(t) and Z(t) at any set 
of times, ^ t x < U • • ■ < '.. • Even when X(t) is a stationary process, 
Z(t) will not in general be stationary, and the joint distribution of X(t) 
and Z(t) at times jT + k , jT + U , ••• , jT + t n will depend on the 
integer ;'. Real world delta modulators, however, "settle down", and 
hence one would expect the distribution just referred to to approach 
a limit as j — > °° . Unfortunately, there are some subtleties to this notion 
due to the periodic nature of the allowed values of X(t), as already 
mentioned. Under suitable regularity assumptions, one limiting dis- 
tribution will be approached as ; — » » through even values j = 2m, 
m = 0, 1, 2, • • • ; another will be obtained as ;' — > oo through odd values, 
;' = 2m + 1, m = 0, 1, 2, • • • . We call the average of these two limit 
distributions "the steady-state distribution." It describes the settled 
down behavior of the delta modulator. The marginal distribution of 
X(t) computed from this steady-state distribution is, of course, still 
the original given distribution for X(t). 

The conditions under which the statistics of delta modulators approach 
limiting forms as just described have been investigated by Gersho. 2 
His work shows that for the cases treated in this paper, the limits 
referred to above exist, and that the density of interest here is given 
by the unique normalized solution of our key equation (22). 

We now measure the accuracy of the delta modulator by the mean 
squared error 

e 2 = 6 2 (A, T) m E ^ £ [X(t) - Z(t)f dt 

where X{t) and Z(t) have the steady-state distribution and E denotes 
expectation. Our main interest is on how e 2 varies with T, A, and the 
statistics of X(0- 

Delta modulation is frequently described by passing reference to a 
block diagram such as is shown in Fig. 2. (The box labelled "filter" 
is called a "perfect integrator" for the case at hand.) On the surface, 
this appears to be much more succinct than (1) and (2) and the subse- 
quent limit discussions. Figure 2 describes a recursive situation, however, 
and so fails to define anything at all unless supplemented with side 
information that either permits the recursion to be started, or serves 
otherwise to define a joint distribution for X(l) and Z(t). Analyses of 
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delta modulation based on Fig. 2 with unstated initial conditions, and 
no limiting arguments are apt to be approximate. 

2.2 Some Heuristics and History 

Let us consider e as a function of A for a fixed sampling period T and 
for fixed-input ensemble statistics satisfying (5). If A is extremely 
large compared to unity, then for the most part of its history Z(t) will 
alternate between the level h and one of the two levels h + A or // — A. 
Thus one expects the asymptotic result 

f 2 (A, r) ~ u 2 

as A — > oo . On the other hand, if A is very small compared to unity, 
Z(t) will rarely wander far from its initial value /( and one expects 
the result 

lim e 2 (A, T) = E[X(t) - I,] 2 = 1 + I, 2 . 

(The rate at which e 2 — > 1 + h 2 as A — > is a more subtle question that 
requires detailed analysis.) Thus the curve of e 2 (A, T) vs A starts 
at e 2 = 1 + h and ultimately rises like ^A 2 . How does it behave in 
between? Does it always dip yielding a best value for A, i.e., a positive 
value for which e is least? 

There have been many analyses of delta modulation in the past. 
The few listed here, 1,8 " 18 provide entry to the literature. Many of them 
predict the existence of a best A > for any T. Their analysis is based 
on the notion that the total error is the sum of two kinds of error- 
quantization error and slope-overload error. The delta modulation 
signal Z(t) can climb or fall at a maximum average rate of A/T = £, 
so that if | (IX /(It | exceeds £ for a length of time much greater than T, 
a serious tracking error will occur. Such a "region of slope overload" 
is seen in Fig. 1 for 8 ^ t/T g 11. In the region ^ t/T ^ S of Fig. 1, 
I dX/dt I < £ and the error here is classified as "quantization error". 
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Fig. 2 — Mock diagram of delta modulator with general feedback filter. 
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This notion of two sorts of error has been very fruitful, and approximate 
calculations based on it agree well with experiment when T is small 
compared to any natural period associated with X(t). This, of course, 
is the case of interest in practice. The calculations are based on many 
approximations, however, and it is difficult to determine their precise 
range of validity without recourse to experiment. 

Two notable exceptions to this approach to the mean squared error 
are the exact treatments by Fine 10 and Aaron and Stanley. 11 The former 
treats a time discrete model with the input process X(nT), n = 0, 1, • • • , 
restricted to have independent increments. Aaron and Stanley treat 
the case in which X(t) is a binary random telegraph signal. Neither 
of these cases is applicable to the transmission of speech or to continuous 
amplitude television signals. The work by Aaron and Stanley, however, 
has much of the flavor of the present study and presents a one-dimen- 
sional version of our key integral equation (22). Closely related work 
is also to be found in the papers of Davisson 13 who presents an integral 
equation and suggests a solution in a series of Hermite functions. 

2.3 Results of Compulations 

The method described later in this paper, in principle, permits exact 
calculation of e 2 whenever X(t) is a stationary Gaussian process with a 
rational power spectral density, 

II (co 2 + C?) 

*(«) = K 4 , (6) 

n (" 2 + <$ 

1 

where m < n and w = 2ir/ is the angular frequency. The complexity 
of the computation grows rapidly with n and consequently we have 
done numerical work only for n = 1 and n — 2. The method involves 
series that unfortunately converge slowly for small T, so that we have 
not been able to explore the interesting region of very small T. 

Figure 3 shows plots of e 2 vs A when the input process X(t) has 
spectrum 

*rM = ri-*- (7) 

The corresponding covariance is 

Prc (t) =EX(t)X(t+ t) = e- |Tl . (8) 

We refer to this as the .KC-noise case. 
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RC-NOISE SIGNAL, h = 

Fig. 3 — Curves of e 2 vs A for delta modulator with RC Gaussiau-noise input. 



On the curves of Fig. 3, a cross points out the optimal value of A, 
that is, the value A min (T) that minimizes e 2 . As T goes to zero, A min 
decreases (slowly) and the corresponding error decreases rapidly. As 
T increases, however, A IIlin reaches a maximum, then starts to decrease 
once more toward zero. Xote that for large sampling times (T > 2.2, say) 
the delta modulator performs poorly indeed. As far as mean squared 
error is concerned, at these rates one would do better by taking the 
constant zero as an approximation to the input than by using the 
delta modulation signal Z{t). 

Figures 4 and 5 show the somewhat similar results obtained for the 
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Fig. 4 — Curves of e 2 vs A for delta modulator with damped RLC Gau.ssiau-uoi.se 
input. 



input spectrum 



2(6 + a) 



(u 2 + a 2 )(u 2 + b 2 ) ' 
corresponding to the covariance 



ab = 1, 



Pdrlc(t) — 



b — a 



[be- alTl - «f ""]. 



(9) 



(10) 



When a and b are real, we refer to the input with spectrum (9) as 
damped RLC noise. The spectrum in this case is unimodal with its 
maximum at the origin. 
When 



a = a -\- ifi, b = a — ifi, 



(11) 
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with a and /3 real, (9) and (10) become 

4a 



$RRLc(u) = 



Prrlc{t) — 



Leo 2 - 08 s - a 2 )]' + 4« 2 /3 

-alrl 



2-3, a 2 + /3 2 =l, (12) 



[a sin | t | + /3 cos /3t]. 



(13) 



For this "resonant RLC noise" case, the spectrum (12) develops a large 
narrow peak at w = 1 as a — > 0. Figures 6 through 9 show the curious 
resonance phenomena that set in as a —> and the input signal becomes 
more and more sinusoidal in nature. For the limiting noise obtained 




DAMPED RLC-NOISE SIGNAL, h =0. a = 0.909, b =1.100 



Fig. 5 — Curves of e 2 vs A for dolt. a modulator with dumped RLC Gaussian-noise 
input. 



2110 THE BELL SYSTEM TECHNICAL JOURNAL, DECEMBER 1972 

1.6 




RESONANT RLC-NOISE SIGNAL. h = 0, « = 0.900, (i =0.436 

Fig. 6 — Curves of « 2 vs A for delta modulator with resonant RLC Gaussian-noise 
input. 



when a — » 0, the single frequency Gaussian ensemble, one can compute 
t by other methods and anomalous shapes for large T similar to those 
of Fig. 9 are found. 

In the range t < 0.4, the curves of Figs. 3 through 9 agree roughly 
with values computed by O'Neal 5 and others. These comparisons can, 
at best, yield approximate agreement, since they are among systems 
differing in a number of assumptions including the spectral shape of 
the signal. The approximate methods, based on quantization noise and 
slope-overload noise will probably continue to be used in practice, as 
they are much simpler to use than the scheme given here. The present 



DELTA MODULATION 



2111 



curves do, however, provide exact values for comparison purposes, and 
this is perhaps the main practical contribution of this paper. 

2.4 Outline of Mathematical Argument 

In this section we outline briefly the mathematical argument of 
Section III, and point out some of the formulae used to obtain the 
numerical results of the preceding section. 

A stationary Gaussian process X(t) with the rational power spectral 
density (6) can always be written as the first component of an ?!-vector 
Gaussian process 

X(0 = \X 1 (t) - X(0, X 2 (t), X z {t), ■■■ , X n (t)\ 




RESONANT RLC-NOISE SIGNAL. h = 0... -0.400. /3 =0.916 

Fig. 7 — Curves of t 2 vs A for dell a modulator with resonant RLC Gaussian-noise 
input. 
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that is Markovian. 16 It is not difficult to see then that the n + 1 quan- 
tities Xi&'D, X 2 (jT), ... , X„0T), Z,_, for j = 1,2, ■■■ , form a 
time-discrete vector Markov process. The first n components can take 
any real values, but the last component is restricted to alternate between 
values in the sets S c and S„ of (3) and (4). The stationary measure, or 
what we call the steady-state distribution, m,(x), satisfies the Chapman- 
Kolmogorov equation (22) with the boundary conditions (23). The 
notation is explained below (23). 

The kernel p T (y | x) of (22) can be developed in a multiple power 
series in the cross-correlations /3,, defined in (31). This power series 
resembles Mehler's formula and involves certain functions i^(x; a) of n 
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variables r, , r, , • • ■ , .'•„ that we call //-dimensional Hermit e functions. 
They are defined in (24) and (39). The parameters a here are the corre- 
lations (26). The expansion of the kernel is given in (46) in a highly 
symbolic form. To understand this equation fully, Section 3.2 and the 
first paragraph of 3.3 must be read. 

The expansion (46), in turn, suggests the expansion (47) of the steady- 
state distribution. We write that symbolic equation in full here: 

>»,«= ££•■•££ ■•• t [nnffi'l 

m-o »,,-o » nn = u Ii-O i„=o Li'-i *-i J 

Thus v is an n X n matrix of indices, and I is an n- vector of indices. 




RESONANT RLC-NOISE SIGNAL, h = 0. (« =0.050, ,« = 0.999 

Fig. 9 — Curves of e 2 vs A for delta modulator with resonant II LC CSaussian-noise 
input-very narrow band ease. 
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Substitution of (47) and (46) in the integral equation (22) yields the 
recurrence (52) for the expansion coefficients /,-„; . This equation in- 
volves quantities p, rs and q i[S defined in (49) and (50). Section 3.4 
shows how these quantities can be computed recursively. 

The remainder of Section 3.3 is concerned with solving the recurrence 
(52). The quantities / l00 are given explicitly by (64) for each i = 0, 
±1, • • • . Equation (74), with the definitions (70) and (73), gives / 0v o • 
The remaining /'s are given by (75) and (52) when these are applied in 
proper sequence. 

With the expansion coefficients /,-„; known, in principle one can write 
down the joint steady-state distribution of X(t) and Z(t) at any number 
of times, and from this quantity derive many statistical properties of 
the delta modulator. Our interest here has centered only on the mean 
squared error e\ In Section 3.5, an expression for this quantity in terms 
of the steady-state distribution ???,-(x) is developed. The expansion (47) 
is then used along with properties of the ?i-dimensional Hermite func- 
tions to obtain a formula, (100), for e 2 involving only the expansion 
coefficients /,-„; and other known quantities. From this formula, the 
values shown on Figs. 3 through 9 were obtained. 

III. MATHEMATICAL TREATMENT 

3.1 The Integral Equation 

Let X(t), the input to the delta modulator, be a continuous stationary 
stochastic process with mean zero, normalized to have variance unity 
as shown in (5). We introduce the following notation: 

a, = h-\- i&, i = 0, ±1, ±2, • • • (14) 

X t mX<jT) t j = 0,1,2,..- (15) 

Pr(y I x) dy = Pr [y ^ X(t + r) < y + dy \ X(t) = x] (16) 

mj'ty) dy s Pr [y £ X } < y + dy, Z,_, = a,-} (17) 

j= 1,2, ••• , »'- 0, ±1, ±2, ..• . 

Thus p T (y | x) is the conditional probability density of one sample of 
the input given the preceding sample, and w [''(?/) dy is the probability 
that Z{t) has the value h + t'A just before the jth sampling instant and 
that the jth sample of the input, X t , lies in a small range about the 
value y. 

The event Z/_i = o, appearing on the right of (17) can occur in two 
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ways: either Z,-_ 2 has the value o,_i and X t -i > a,_, ; or else Z,_ 2 = a ivi 
and X,-, ^ a I + , . Thus (17) can be written 

ffl!'^) dy = Pr {y ^ X, < /y + dy, X,._, > a,_, , Z,_ 2 = a,_,j 

+ Pr {// ^ X, < vy + dy, X,_, ^ a, +1 , Z,_ 2 = a, +1 ). 

= dy I* m^WQjiy | .r, z - 1) tf.r 
+ dy f "' m^WQjiy \ x, i + 1) dx (18) 

J -to 

where 

Q,(2/ I as, * - Pr h/ g X,- < 2/ + <ty I X,-i - x, Z,_ 2 = a,|. 

Now, ?'/ X(t) is Markovian, 

Qi(y I x, i) = p T (y I x) 
and (18) becomes 

mS'ty) = £ m[LV ) (.v)p T (y\x)dx 

+ f ' m l i {- 1 1) (x)p T (y\x)dx. (19) 

The pair of processes X(t) and Z(t) then form a 2-component vector 
Markov process. One component, Z(t), takes discrete values; the other, 
X(t), takes continuous values. Equation (19) is the Chapman-Kolmo- 
gorov equation for this vector process. 

We have commented in Section II that w?J- 2,) G/) and mj 2,+1) (y) will 
in general have different limiting forms as j — > °o. By replacing j by 
j + 1 in (19) and adding the result to (19), one finds that 

*l"df) - Mmi'^) + mi' +,, <y)] 
also satisfies (19). Taking the limit as ;'—><», we then have 

™.(l/) = J m t -i(x)Pr(aj I •'") <& + J m i+l {x)p T (y | .t) dx (20) 

where 

w,(//) = lim m^iy) 

i-tc 

is the steady-state joint distribution for X(/) and Z(t). Equation (20) 
must be supplemented with the boundary condition 
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£ m<Cs) = p(.t) (21) 

(—00 

where p(x) is the probability density for X(t). 

The foregoing generalizes readily to the case in which X(t) is not 
itself Markovian but is one component, say the first, of an n-component 
stationary-vector Markov process. Denote this process by X(t) = 
{Xi(0 = X(t), X 2 (t), ••• , X n (t)\. We imagine a delta modulator 
generating approximations Z, to Xi(jT) in the manner already described. 
With an obvious extension of our previous notation, we find 

/CO rtOO *00 

dx„ ■■• I dx 2 J dxitrii-iixyprfj | x) 

/OO /lOO /»Oi+i 

dx n ■•■ dx 2 / dx 1 m i+l (x)p T (y | x), 

-CO •'—CO ^ — CO 

i = 0, ±1, ±2, ■•• (22) 
£ m«(x) = pCs). (23) 

I--00 

Here, of course, x and y are ?i-vectors, p T (y \ x) is the conditional 
probability density of X(/ + r) given X(0, p(x) is the density of X(t), 
and m,(y) is the steady-state distribution for X(/) and Z(0, the index i 
referring to the value a, = h + iA for Z(i). Equations (22) and (23) 
are the basic ones on which this paper is built. 

In all that follows, we restrict our consideration to inputs X(t) that 
are Gaussian. It is well-known 16 that if, in this case, X(t) has a rational 
power density spectrum of form (6), then it can indeed be written as 
the first component of an ?i-vector Gaussian process X(t) that is Mar- 
kovian. When m = in (6), by which we mean that the numerator 
shown there is a constant independent of o>, the higher order components 
of X(t) can be taken as the derivatives of X(t), i.e., X i+l (t) = d'X(t)/dt' , 
j sb 1, 2, — , n — 1. For the more general case m ^ 1, see the article 10 
by Helstrom. 

To indicate in full the quantities appearing in (22) and (23) in this 
Gaussian case, we introduce some further notation. Denote the n- 
variate Gaussian density with zero means by 

* (X; p) = (arr I P I* GXP ("2 ? p7fXiX ') (24) 

where g is a positive definite n X n matrix, the inverse of which has 
elements p~). The right side of (23) is then given by 
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p(«) - *(z; a) (25) 

where a is the covariance matrix of X(0, i.e., 

«„■ = £X<(0X,(0, i, j = 1, 2, • • • , n. (26) 

The kernel of (22) is given explicitly by 

Pr(y | x) - Vt (x, y)/p(x) (27) 

where 

p T (x, y) = +(z; e ). (28) 

Here the 2n-vector z has components 

Zi = x {i 2 n+ , = y< , »- 1,2, ••• ,n (29) 

and 9 has the special partitioned structure 

« ?] 



e = 

where 



Q « 



(30) 



ft, = E[X&)X& + 7 1 )], *, i = 1, 2, • • • , n, (31) 

a is given by (26), and the tilde denotes transpose. 

We shall show in later sections how explicit series solutions can be 
found to (22) and (23) in this Gaussian rational spectrum case. But 
first some further preliminaries are necessary. 

3.2 A Generalized Mehler's Formula 

When n = 1, (24) becomes the standard normal density 

m = -7==*"***. (32) 

Denote its derivatives by 

h(x) = £/*(■<•), l = 0,1,2, .... (33) 

Now a = 1 and (5 = /3 and (28) has the series representation 

Pt{x ' v) = 27vr=7 exp v 2d -« J 

= Z^Ur)U'j), (34) 
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an expansion known as Mehler's formula. 17 It is the power series for the 
normalized bivariate Gaussian density in terms of the correlation /3 
between the variables. We need the corresponding multiple power series 
expansion of the 2«-variate density (28) in terms of the correlations 
fin of (31). The series is derived in Ref. IS: to present it, yet further 
introduction of notation is necessary. 

Boldface lower-case Greek letters, y, v, etc., will be used henceforth 
to denote matrices; boldface lower-case Latin letters, I, m, etc., will 
denote vectors. If v is a matrix with ?/i rows and n 2 columns, we write 

r(v) = (r x , r 2 , • ■ • , r ni ) 
r t = £j\, , i = I, ■■■ ,n 1 (35) 

for the vector whose components are the row sums of v, and we write 
c(v) = (c, , c 2 , • • • , O 

c, = Z*« , j - 1, •■ ,n 2 (36) 

for the vector, the components of which are the column sums of v. 
Throughout we adopt the convenient abbreviations 

« I »' t 

00 00 00 00 00 00 CO 

Z- E Z •• Z - Z-Z • • Z (37) 

► -0 i"ii=0 »i,-0 fmni-O /=0 l,=0 J„ = 

where the entries of y are ju, y , the components of / are /, , etc. We call a 
matrix of nonnegative integers, such as v in the last line of (37), an 
index matrix; a vector of nonnegative integers, such as I, is an index 
vector. The statement s ^ t means that no component of s is greater 
than the corresponding component of t; the statement s < t means 
s ^ t and s^t. Inequalities between matrices, e.g., y ^ v are to be 
interpreted in a similar manner. Finally, we write 

M - h + h + • ■ • + h (38) 

for the sum of the components of a vector, and we define 

h( *> e) = a «« a ?■' ' -Tu +(*■> ») (39) 

ax i ax 2 ■ ■ • ox„ 

where the Gaussian density ^(x; p) is given by (24). 
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The desired generalization of Mehler's formula is 

Pr(*, y) = E fr *'<•>(*; a )^'v>(y; «)■ ( 4 °) 

It is a multiple power series for the density of two identically distributed 
Gaussian vectors in terms of the cross correlations between the com- 
ponents of the vectors. 

The functions i^(x; a) defined in (39) that occur in (40) are closely 
related to the Hermite polynomials of several variables studied by 
Erdeiyi 10 and others. We call ^/(x; a) an n-dimensional Hermite junction 
of weight [I] [see (38)]. The following facts about them that will be of 
use to us later are established in Ref. 18. 

(i) If f, , U , ■ ■ • , lr are r distinct n -vectors with nonnegative integers 
as components, then ^,,(x, a), fo,(x, «), "• lM x > a ) are linearly 
independent functions of x. Hermite functions have the generating 
function 

<Kx + t ;e ) = £,y.H*;Q), ( 41 ) 

l=o I- 

which is just Taylor's theorem in many variables. 
(ii) There are 

^,p) = (" + P 1 ) m 

n-dimensional Hermite functions of weight p. Functions of different 
weight are orthogonal with respect to the weight function 

(Hi) The scalar product of any two functions of the same weight p can 
be expressed in terms of an N(n, p) X N(n, p) matrix, dp(p _I ), known 
as the symmetrized Kronccker pth power of p -1 . We have the formula 

/ - 1 ,— [ dx t ■■■ f dxnffe; e)^m(x; p)w(x; p) 
VV. Vm! •>-» J-« 

= 5 iniin ,d in (p~V (44) 

where 5,, is the usual Kronccker symbol. An explicit formula for the 

matrix d„ is 



d„(«) ta - Vl\ Vm! £ S ( 45 ) 

» v- 

r(»)-l 

c(u) = m 



2120 THE BELL SYSTEM TECHNICAL JOURNAL, DECEMBER 1972 

As indicated, the sum here is over all index matrices u with row-sum 
vector I and column-sum vector m, these latter being of weight p. 

3.3 Series Solution of the Integral Equation 

Wc now return to consideration of the system of eqs. (22) and (23) 
where the density p(x) and p T (y | x) are defined by (24) through (31). 
To simplify notation we shall frequently write ^i(x) for ^,(x; a), the 
unexpressed matrix always being a. Unless otherwise explicitly stated, 
boldface Greek letters will denote n X n matrices while boldface 
Latin letters will denote //-vectors. 

Equations (40), (27) and (2.5) show that the kernel of (22) can be 
written 

vAy\x)=±£ *-'<< ( f:'<' ( ?\ (46) 

the conventions (37) being understood here. This suggests a series 
solution to (22) and (23) in the form 

w,(x) = 2 &7«.i*i(r). (47) 

v./ = 

Conditions on the coefficients /,.„, are then obtained by substituting (47) 
and (46) into (22). There results 

E &7m*i<7) 



where 



and 



3 

= E —f ^c<»)(y)[/,--l d s g.-l s r(»> + /,■+! d ,Vi*\ s r<»>] (48) 

dps V • 



On setting y = v — d, the right of (48) becomes 



™,(y) - E (T E >Ac,v-d,(y) r J -r T 

d=o (v — <*;! 



' 2-1 Ui-1 d B?«-l s r(v-dl + Ji+1 d lP<+| s r(v-d)]- (51) 

8 

But this form shows that in (47) the I sum could be restricted to run 
from to c(v). This in turn restricts the s sum in (51) to run from 
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to c(d). Equating coefficients of powers of (5 on the left of (38) and the 
right of (51) gives 

l!/M*iCr> = £,*.w(i)h 

(v-B) 

2^ L/i-1 *-v sQi-l s r(y> ~f" Ji+I v-y sPi + l s r (y)J 



c(v-y) 

■ E 

s-0 



where we have written d = v — y to reintroduce y. Using the linear 
independence of the ^/(y), we find finally 

j c(v-y) 

fill— Z-/' ~ i Z-i [/>-' »-» s9i-l s r(p) + /itl.-vsPi + lsrd,)], 
u tf! s=o 

^ / ^ c(v), t- 0, ±1, ±2, ••• , (52) 

which holds for all v ^ 0. Here the sum is over all index arrays y with 
^ y ^ v and c(y) = I. 

In the remaining paragraphs of this section we develop (52) to show 
how a recurrence scheme can be arrived at that permits successive 
determination of the /, vf . 

We note that from (52) 

C(v) 

/.vO = £ [/.-l v mii-1 s + fi+1 v mVi*\ s o] 
s = 

= / «— i v o9i-i oo t /i + i %• oP<+i o o 

C(v) 

+ X) [/.-i v s9,-i s o + /,. i v .p<+i s o], (53) 

where we assume v^O, 
Again from (52) 

/i-1 v s = 2-/ ~~ i ^ [/,-2 v-y t?i-2 t r( V ) + /i v-u tPi t r( P )J 

, y! t=0 

where the sum on y is over all arrays with y f£ v and c(y) = s. A 
similar expression can be written for /, + , v s . Replace the /'s appearing 
in brackets on the right of (53) by these expressions. There results 

7iv0 = /«-! v dfff-l ~T /i + l v oPi + l o o 

C(v) -I C(v-y) 

s*0 y y- t=0 

tEp.^oE'V'e^., W 

s^o u y. t=o 
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whore we have written 

tlit V v = Ji-2 v-u tQi-2 t r((.) + Ji v-p tP. t r( S ) • 

Now in the first sum on the right o m f (54), 



C(v) -. c(v-ll) 

T = 2 Qi-i s oE'-f Z) h itvv , 

s^O 1.1 V- t=0 



substitute d = v — y to obtain 



C(v) 



r — 2^ fff-i bo Li ,\i L &< t v-d v 

s*0 d=0 (v _ oj! t=0 

where the middle sum is over all arrays d with ^ d ^ v and c(d) = 
c(v) — s. Since s varies in the range < s ^ c(v), however, d indeed 
ultimately takes on all values < v. Thus 

-1 c(d) 

■*■ = 2-t Qi-i c(v-d) o 7 ~^r, 2^ ""i t v-d v • 

o £ d<v (v — 6)1 fTo 

Using a similar rearrangement for the last sum in (54) one finds finally 

JtvO = h-i v 0Qi-l + /»•+! v oPt + l oo+ / . 



where 



o S d<v (v — d)! 

c(d) 

2-1 L/t-2 d t^i-2 v-d t + /i d t-O. v-d t + /i+2 d tCi + 2 v-d t] (55) 

t=0 

■a-tyt = <7i + l c((j) 0?i r(p) t 

"f»t = <?i-l c(p) oP. r(y) t + P. + l c(y) oQ't r( B ) t 
Wft = Pi-1 cCii) OP, rCp) t • (56) 

If v = 0, the sums in (55) are to be interpreted as zero. 
The quantities A, B and C just introduced are not independent. 
On using (44) and the definitions (49) and (50), we find 

P.rs + (Z.rs = Sin.iB] r! s! lT,rl(Or. • (57) 

Now sum (56) to find 

A iv t + &i v t + W»t = Qi r(ij) tLPi+l c(„) + Q'i + I c(|i) o] 

+ Pi T( V ) tlPi-l c(ii) + Qi-l c( v ) o] 
= [QitW t +P*rf»| t] 5 B 
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or finally 

A ivt + B lvt + C, v , = 5 tf0 5to- (58) 

We note now that the normalization (23) together with (47) yields 

E/,w= 8.0 « 10, (59) 

a normalization requirement of the /'s. 
Now consider (55) when v = 0, 

/.'oo = /.-i o offi-i oo + /. + i o op.+i o o • (60) 

Since by (57) p l0 o + tf.oo = 1, (60) can be rewritten as 

fiooQiOo — /. + i o oPi+i oo = /.-i o o<?.-i o o — /.ooP.oo (61) 

which is to hold for all i. Now p, 00 and g l0 o are bounded for all f, and 
by (59) the /'s are summable. Both sides of (61) are therefore summable, 
and summing for i = I, I + 1, 1 + 2, • • ■ , we find 

/l-l o offi-i o ~~ JiooPioo = (."-) 

which holds for all /. In addition, from (59), 

E/.oo = l- (63) 

These equations are readily solved by setting 
w = 1 

»,-^**iph, J -1,2, ••■ 

PlOO 

„,,_, 2i«!_ w . f ,' -0,-1,-2, ••• 

9,-i oo 

With the /,oo now determined, we turn our attention to (55) for 
v^O. Replace B, v _ d , there by - A { v _ d t - C v _ d t as is allowed by 
(58). Multiply /, v0 by 1 = p.oo + ?,oo and regroup terms to obtain 

«, + v, = Ui-t + v,-2 (6- r >) 
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where 

u i = / ivOQ'iOO — Jt + 1 v oPi+1 
1 c(d) 

y . - £ 7 7TT Z) L/.-dtA,- v _ d t - /, +2 d tC 1+2 v _ rf t ]. (66) 

os<i<v \y — O)'- t=0 

Equation (65) is to hold for all i = 0, ±1, ±2, • • • . The quantities 
A-i^t , C iv t , Pi TB , q iTS are all bounded in i. The /'s are summable by (59) 
and hence so are the w, and u, . Summing (65) for i = I, I + 1, • • ■ , 
there results 

u t = — (v, + »i-i). 

Using (66) this becomes 

/.• + i » oP,+i o o — /,■ .09.00 = ^.v (67) 

where 

-I c(d) 

"tv = 2^ 7 I\7 2-/ L/t'-l d t-^i-l v-d t T littA-i v-d t 

0Sd<v 1>V — OJI t =0 

— /«" + l d tW+l v-d t Ji + 2 d t^i + 2 v-d tj ■ \Po) 

Suppose now that the d iv are known for i = 0, ±1, ±2, • • • . If we 
can solve (67) subject to 

Z /,vo = (69) 

as required by (59), our recurrence is complete, for the d iv depend only 
on the j, vt with y < v. Equation (52) for / > permits computation 
of the f ivl , i = 0, ±1, ±2, • • • in terms of the /,„, , y < v. The values 
(64) start the recurrence off. 

Now the solution to (67) subject to (69) is quite straightforward. 
Introduce the notation £, = /, v0 , i = 0, 1, 2, • ■ • , 77, = /_ lv0 , i = 
0, 1,2,-., 

T/-+ _ gi-1 y- _ P-(i-l) 00 

P«w 9-100 

/'■oo y-ioo 

Equation (67) can be written 

fc+i = VU& +Dt +i , i = 0, 1,2, ••• 
tj i + 1 = F7 +1 r?, + D7 + i , *- 0,1,2, -. 
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whence 

£n = vo 

c< = in n f? + E z>, + ri v; + z>? 



1-1 I + I 



Vi = no U VJ + E *>7 U V; + D1 i - 1, 2, • ■ • . (71) 

1 = 1 I - 1 I ' + 1 

Adding these equations we find 

So + E e« + E i< - fed + f~ + v + ) + E ^ + A + + E ^7 -or 

ii ii 

(72) 
where 

V + = Vt + 7, + F 2 + + 7r7 2 + 7 8 + + • • • 

- E IT n 

i-l »-l 

V- = t fl F7 

i=i j = i 

/>; = F7K, &r = ^v^r 
l; = (l;_, - iyy;, 

L" = (L"_, - l)/77 i = 2,3, .... (73) 

But the left of (72) is the sum shown in (69) and hence vanishes. We 
have then 

E (l; d? + l; dj) 

£o = /l)vO — — y- _|_ j _j_ y+ ('4) 

with the quantities on the right given explicitly by (70) and (73). With 
/ovo known, one can return to (67) in the form 

/,- + ! v O = [/.vOtf.OO + tf.-vL i = 0, 1, 2, • • • 

Pi + l 00 

/■vo = [/, + i ,oP.-+i oo - d iv ], i - — 1, -2, • • • (75) 

9ioo 

to compute the remaining /'s recursively, or one can utilize the explicit 
solutions (71). 
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3.4 Recursion for the p iIB 

The formulas just developed for computing the coefficients f ivl 
involve the quantities p iTS and g ir8 . The latter are given in terms of 
the former by (57). We turn our attention now to a recursive method of 
computing the p's. 

From the generating function (41) we find 

flx + Qflx + n) = y rLMlM?) 
tKx) " ^r!s! iKx) 

= cxp (£«7/&i?,) 

cxp [-j S a t }{x t + fr + ? ,)fa + g, + n,)] 
(27r) n/2 | a |* 

(76) 

where 3; and n are w-vcctors. Recall now the definition (49) of p iIB . 
Integration of (76) then gives 

S ITTT P'« = ex P ( X) <*7/£.%) / rz dy 

= exp (2 "l&ViMat + & + *,). (77) 

Take the partial derivative of this relation with respect to £,- , j > 1, 
to obtain 

c,n t-T i i i.rn s n yr B 

or 

PiTB = E«i* S *P<r,-(r,-l)-r.. l ".(i.-l)."i, , 7 > 1. (78) 

A similar formula, obtained by differentiation with respect to r) k , 

Pir* = 2«r*»'rf»«r 1 ...(r»-l)".r.. 1 ...(t,-l)...f. , A>1 (79) 

also holds. 

Repeated use of (78) and (79) permits one to express p iI8 as a linear 
combination of the quantities p ifl0 o • •• oj.oo ••• o where ^ r\ 5; i"i and 
^ s t ^ S] . Let us now define 

Prm — P«riOO-"0«iOO'"0 
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and seek rules to determine these quantities. We have 

£ ^TTl P— = CX P (+*nbh)F(ai + €. + *i) (80) 

with F defined by (77). Without loss of generality, we take a n = 1 
and note that 



= -7=^. (81) 

''-oo \ lie 



(82) 



Now differentiate (SO) with respect to £, to obtain 

S(r-l)! S ! P " = ^'^Hri*" + GXP (ai1 ^ V£ 
where we have dropped some unnecessary subscripts. Let 

exp (fltfe,) v - = E jr|| M , a . (83) 

Equation (82) then gives 

p r+l , = a~\sp r s -i + M r , 

and its symmetric version obtained by interchanging the roles of r and s. 
These equations yield 

M r , + , - M, r+1 
*<• = ~ «;t(r - s) ' r * s 

p Tr =auVp r _ lr _ 1 + M r _ lr . (84) 

To complete the recurrence we must have rules for generating the M's. 
Differentiating (83) with respect to £ gives 

M i+i t - - aM ih - (1 - a&kMi ,_, - jM,-t k (85) 

which permits reduction on j, so that M jk can be expressed in terms 
of M ok > with ^ /c' ^ k. But from its definition, M jk — M, :i and from 
(85) we deduce 

Mot = - ail/o ,.-1 - (* - l)il/ ,-2 ■ (86) 

Finally, we find 

Moo = *-7== 

M 01 = -a.^=- (87) 

V2tt 
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3.5 The Mean Squared Error 

The mean squared error of the delta modulator running in the steady 
state is defined by 

i = \ j' dtE[X(t) - Z(t)f (88) 

where the expectation is to be taken using the steady-state distribution 
of X(t) and Z(t). Then 

* 2 = f [ dt £ JT dy[y - atfPtiy, t) (89) 

where 

P t (y, t)dy = Pr [y ^ X(t) < y + dy, Z(t) = a,} 
and so 

<&„••• / dz 2 / dxmi-iWVtiy I x) 

•00 ^ —00 •'Oi-i 

/OO rtOO /»Oi+i 

<&»••• / cfo 2 / da:,w 1+1 (x)p £ (?/ | x). (90) 
-oo "—oo «-oo 

In this last equation p t (y | x)dy is the conditional probability that 
y ^ X(t) <y + dy given that X(0) = x. The expressions (89) and (90) 
can also be found easily from the alternate definition 

e 2 = lim^Z? f 2 ^ dt[X(t) - Z(l)f 

l-oo *•*■ J2iT 

where the expectation is over the actual time varying distribution of 
X(t) and Z(t), not the steady-state distribution. We proceed now to 
express t in terms of the /, v ;. 

The integration on y in (89) can be carried out directly. Using standard 
formulae for Gaussian variates, one finds 

E[X(t) | X(0) = x] = P dyyHy I x) 

•'-oo 

= E^ (91) 

1 
where 

c, = £«7X(0, (92) 
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and where we now exhibit explicitly the time dependence of |8 ,-,-(£) = 
EX^ujXiiu + t). We find further that 

E[X\t) | X(0) = x] = f dy^fe | x) 

J-oo 



(93) 



With these results, (89) and (90) can be rearranged to give 
* = f J dt S i dx » "] d*iw»«_i(x) 

+ |" dr n • • • j""" d.r lWl+I (x)J[A + ifl + *' 2 A 2 ] 

where 

A = a„ - £ a7/0„OIMf) + £ W.s, - 2/i £ c,s, + h 2 (94) 

and 

E = -2A YiWi + 2M ( 95 ) 

are independent of the index i of (93). Now 

/CO ;1 CO 

cte„ • • • / dxWi-SdA 

+ £ /" **■ • • • / " ^'.^. + .(x)A = J" dx*(x)A 
by (23). But 

/00 P CO /too 

dxxrfix) = 0, / (/x.r,,r,</<x) = a u , I dx\f,(x) = 1, 

-co *'— OQ V — oo 

so that one finds finally 

f dx+(x)A = «„ - £ a^MO&iCO + EWf + ** 

= ocA + /> 2 (96) 

on using (92). The mean squared error can thus be written 

L z = « n + /r + 7, + 7 2 (97) 
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where 

/OO ncQ 

dx n •■■ / dxi7n,_i(x) 
_ -00 "ai-\ 



+ P dx n • • • J ' * dxxW.+xCx) \[2iAh + i 2 A 2 ] (98) 
and 

12 = f J dt £ i dx n ■■■ J dx^i-^x) 

+ j dx n ••■ f dXiW.+iCx) [-2tA £c,x,]. (99) 

The expressions (98) and (99) can be reduced further by using (47). 
One finds directly, for example, that 

I^IE 5 v CTO,-i v /g,-i <o + f M v /P, +1 , ][2t'A/> + i 2 A 2 ] 

i v( 

= Lrcn E/.vo[i2A/i + t 2 A 2 ]. 

Here we have used (49), (50) and (52) with I = 0. To reduce I 2 , we 
first note that from (24) one has 

-+ s: = £ a "' x ' • 

From (92) we thus obtain 

Using this result and (47), we find 

h - \, f dt i; 2 rcn 

• X /3,i(0[/.-i v zff.-i 10/ + /, + i v tf>,-+i ie,]2z'A 
i 

where e, is the vector having unity for its jth component and zero 
for all other components. Finally defining 

.T 



Qn = Z in*, h ( dtpM 

,=1 J- Jo 

;=1 J «<0 
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we have our desired result 

e 2 = «„ + h 2 + e ran e uj^ah + ; 2 a 2 j 

+ E TO E L/.-. v A-, i + /,« v iP i+l i]2iA. (100) 

IV. GENERALIZATION TO SYSTEMS WITH REALIZABLE FEEDBACK FILTERS 

4.1 Description of the System 

In this section we consider the modulator of Fig. 2 where the feedback 
filter is a realizable one with a rational transfer function. Again we 
assume that the input X(t) to the modulator is the first component 
of a vector Markov process 

X(0 = |Xi(fl = X(t), X 2 (t), ■■■ , X n (t)} (101) 

with X(t) normalized as in (5). We shall show how an integral equation 
(131) that generalizes (22) can be written for the steady-state prob- 
ability distribution of this system. 

Let us first describe the system more precisely. The sampler acts at the 
instants kT, k = 0, 1, 2, • • • , and its output at time jT is X[ n - Z U) 
where we write 

X\» = X { (jT) 

Z U) = Z(jT-) = lim Z(jT - e), e > 

<-*0 

i= 1,2, ... ,n, j = 0,1,2, ••• . (102) 

This output is acted upon by the quantizer, which at time jT produces 
an impulse of magnitude £/, that is applied instantaneously to the 
filter. We suppose a K-level quantizer with representative values 
«i , «2 . • • • , a-k and decision regions (R, , (R 2 , • • • , (R* . Thus, 

Uj = o, if X{" - Z li) t (R, 

i = 1,2, ••• ,K, j = 0, 1, 2, .... (103) 

The? (R's are disjoint sets, the union of which exhausts the real line. We 
suppose the filter described by a real impulse function h(r) with 

h(r) =0, r < 0, (104) 

and that the filter output is 

Z(t) = E UM - kT), jT^t< (j + 1)T 

j - 0,1,2, ■•■ . (105) 
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Finally, we define 

Z (0) = Z(O-) = (106) 

and suppose the system inactive before time t = 0. Thus the filter 
input and output are zero for all t < 0. The system starts up at t = 
when Uo, which depends only on X(0), is applied as the first input 
to the feedback filter. 

4.2 The Markov Nature of the Filter 

Suppose now that the transfer function of the filter is rational, 

fc(r) = f ftW'^ (107) 

where P(w) and Q(o>) arc polynomials in co. Let the degree of Q be m 
and denote its roots by ur it j = 1, 2, • • • , m so that 

Q(w) = d n (w - *>,-) (108) 

where d is independent of w. For simplicity we shall assume that all 
m roots are distinct and that none are also roots of P(u>). Expansion 
of P/Q in partial fractions shows that 



*>-?=*/>' 



A, 



CO — l<Ti 



= 23 A,/(<7, , r) (109) 



/Or, r) = I*'"' T > ° (110) 



where 



0, t < 0. 

For convenience, we define /(«r, 0) = 1. Here we must have 

Re (<r,) > j = 1,2, ••• ,m (111) 

to insure (104), while the reality of h(r) requires that non-real <r's 
occur in complex conjugate pairs. The corresponding A's of each such 
pair in (109) are complex conjugates of each other. 

Now it is well known and easy to establish that when such a filter 
is excited by impulses as in (105), its output at all times can be given 
by the first component of an m-dimensional state vector 

Z(t) = \Z v {t) = Z(t), Z 2 (t), ■■■ , Z m (t)}, (112) 
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that satisfies the equation 

ZOT + = D(DZ M1 + t'M), (113) 

o ^ € < r j - o, i, 2, .. . 

Here the m X m matrix D(£) and the m-vector h(£) are independent 
of ;. The time-discrete state vector 

Z w = Z(jT-) = lim Z(jT - e), e > (114) 

satisfies the recurrence 

Z H+ " = DZ (,) + f/,h (115) 

where 

D = D(D, h = h(D, (116) 

which follows from (113) by letting £ — > T. 

The validity of (113) can be established in a few lines. Let 

h( T ) - |fc,( T ) = h{r),h 2 {r), ■■■ , h m (r)\ (117) 

be the m-vector, the fth component of which is 

I'M m £ A,.^- 1 /^ , r) 

l 

- Ec/fo ,r) i = 1,2, ••• , »i (118) 

i 

where 

C, = Ajo}- 1 . (119) 

For p = 0, 1, 2, • • ■ , one then has the system of equations 

h,(pT) = E c ti e-' ,vT } I = 1, 2, • • • , m (120) 

i-i 

which can be solved inversely to give 

e~'" T = t, cjX(pT), j = 1, 2, • • • , m. (121) 

*=i 

Here c~i is an element from the matrix inverse to c = (c,,-). The latter 
is non-singular since its determinant as computed from (119) is 



- 11^- IK*,--**) 
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which is not zero by our assumption of distinct roots for Q(a>). 
Now from (120) and (121) it follows that for £ > -pT 

h,(pT + Q = i>„<r'V" pr 
i -i 

= E c,,*-' 1 E c7*ft*(pT) 

1=1 *=i 

= £, d lk (0h k (j)T) 
t=i 

or, in vector notation, that 

h(pT + £) = DG)h(pT), pT + J > (122) 

with 

D(B = (<*.,), d„ = Ic it rW- (123) 

<fc = l 

This is the key to (113). We now define 

z(0 ^ 2 W* - ^T), ? t ^ < < 0' + i)r 

*=o 

i = 0,1,2, •■• (124) 
which has (105) for its first component. Then 

Z(pT + Q = E C/ 4 h(pT - AT + 



p-1 



= E w(p - *or + a + iwd 



p-1 



- D(0 E UM(P - 1 - k)T + n + CW0 

* = 

= D(|)Z(pT-) + t/phft) (125) 

by (122). But this is (113). For this equation to hold for p = 0, we 
must define 

Z (0> m 0. (126) 

4.3 The Integral Equation 

From (115) and (102), it is seen that Z" +1) can be defined in terms 
of the random variables X ( " and Z ( ". Since X ( " is assumed Markovian, 
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it readily follows that the m + n quantities 

X['\ X<'\ ••• , X l J\ Z['\ Z f », ■■■ , Z™ (127) 

constitute the components of an (m + n) -dimensional time-discrete 
vector Markov process. Denote by m (,) (x, z) the joint density of 
X (,) andZ ( '\ 



m 



M) <* ■) n <** n &,■ 



= Pr |.r, S Xi" £ .r, + dx, , • ■ • , x n g Zi n ^ *. + dar. , 

•2l ^ Z{" ^ 2, + dz, , • • • , Z m S Z™ ^ Z m + d2 m } . 

Then 



m 



"V, z') = j dx f dzp(x', z' | x, zV'-"(x, z) 



where p(x', z' | x, z) is the transition density for the process (127) 
and is independent of ;. The steady-state distribution m(x, z) for 
the process must then satisfy 

m(x', z') = J dx J dzp(x', z' \ x, z)m{x, z). (128) 

For the case at hand, the transition density takes a very special 
form. Let 

x,(x,z) = | 1 ' <*-*)■«« i=l,2,---,K (129) 



.0, (x t - 2,) i (R, 

describe the quantizer decision regions. Then from (113) and (103) 
we find that 

K 

p(x', z' I x, z) = £ x,(x, z)p r (x' I x) 5(z' - Dz - a,h) (130) 

i = l 

where 5 is the usual Dirac symbol and as in (110) p r (y | x) is the prob- 
ability density of X(t + r) given X(t). Inserting (130) into (128) and 
carrying out the z-integration gives the desired integral equation 

| D | w(x', Dz) 

= Z [ dx Xi (x, z - a, D"'h)p r (x' | x)w(x, z - a, D"'h), (131) 
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with | D | the determinant of D. This equation is to be augmented 
with the condition 

/ m(x, z) dz = p(x) 

with p(x) as in (111). 

We have not seen how to solve (131). The simplest example occurs 
when m = n — 1. We then have RC noise for the signal and an RC 
filter with impulse response h(r) = e~' T , t > 0, say, in the feedback 
path. Taking a, = A, a 2 = —A and (Ri the positive axis gives for (131) 

ym(x', yz) = / dxm(x, z - A)p(x' | x) + / dxm{x, z + A)p(x' \ x) 

J i — A J— oo 



-aT 



where y = e 
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